Same thing happened to me on Saturday, two men, from a congregation in our area, they knew we did not go to meetings but said they were out in service and would not just go by without calling. I was very kind and polite, told them we were just fine and explained a little of the trauma we have had with our son being injured in Afghan. They said we were always welcome at the meetings and I said I knew that was the case. I told them we never discuss our reasons for not attending with anyone and would not do so in the future. The said they would pop by another time and I was very kind and said they were welcome but that we are just fine and happy as we are. I felt no panic, no need to tell them about their religion, no sense of anger ...nothing. Just like a worldly person who gets called on, on a Saturday morning. Quite funny though because my husband was downstairs marking school papers and he had come up to see who it was, he had on a black tshirt with a huge devil head and underneath it says: God is busy, can I help you? I laughed so much thinking about how they would have responded if he had anwsered the door, former elder and speaker at district conventions etc. Funny.